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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse Secret System (IDW- 
S) is an initial data warehouse, content management and data mimng system that will permit FBI 
investigative, anal)dical, administrative and intelligence personnel to access aggregated data 
previously only available through individual applications. The IDW-S system will be authorized 
to process classified national security data up to, and including. Secret. The IDW-S system is the 
successor to the Secure Collaboration Operational Prototype Environment (SCOPE), which 
originally was named the Secure Counter-Terrorism Operational Prototype Environment. 



Data processed by the system will include the following data sets: cn 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 
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• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (V GTOF) from the Criininal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
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Outside the Scope 

1.2.2 Supported Projects 

IDW-S is an FBI enterprise program/system and utilizes data feeds from several FBI (and other 
agency) programs. 
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3.5. Data Processed 

IDW-S processes data from the following data sources, with the security classification of the 
source indicated in brackets: 

• Automated Case Support (ACS) System, Electronic Case File (ECF) Subsystem 
[Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network — Secret (SAMNet-S) [Secret and below] 

• NCIC Violent Gang and Terrorist Offender File (V GTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DARPA/TIDES Open Source News [Unclassified] outsxde the scope 
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3.5.1 ACSECF 


Data Sources w/Transfer Mechanism 


IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the Automated Case 
System (ACS). This subset consists of serials in those case classifications/sub classifications that 
have been officially sanctioned for inclusion in IDW-S. For each such serial, the ECF data 
includes metadata and text. IDW-S is synchronized against the ECF system once a day, a process 
which consists o f receiving and processing the previous day’s increment of ADD, MOD, and 
DELETE records! I 
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3.5.5 JICI 
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3.5.6 Open Source News 

The IDW-S VI .0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source N ews data is received in the form of text files 

(one per news article The Open Source News data goes into IDW-S 

once a day. Open Source JNews data iJ 
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3.9.9 Indirect Connections outside the scope 


IDW-S connects to the following sources of data: 
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INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse Secret System (IDW- 
S) is an initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated data 
previously only available through individual applications. Hie IDW-S system will be authorized 
to process classified national security data up to, and including. Secret. The IDW-S system is the 
successor to the Secure Collaboration Operational Prototype Environment (SCOPE), which 
originally was named the Secure Counter-Terrorism Operational Prototype Environment. 



Data processed by the system will include the following data sets: 

• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 
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• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the Criminal 
Justice Information Systems (CJIS) Division; 

• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open Source 
Data 


Outside the Scope 
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• Automated Case Support (ACS) System, Electronic Case File (ECF) Subsystem 
[Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 


• DARP A/TIDES Open Source News [Unclassified] 

Data from each source is held in an identified source Library against which users can direct the 
analytical tools. 

[Data Ingest j 



- Received data is parsed into individual serial records (in the case of ACS 
ECF), documents (fritelPlus, JICI, Open Source News), messages (SAMNet), 
or files (VGTOF). 
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3.5. Data Processed 
IDW-S processes the following data: 

3.5.1 ACS ECF 

IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the Automated Case 
System (ACS). This subset consists of serials in those case classifications/sub classifications that 
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have been officially sanctioned for inclusion in IDW-S, For each such serial, the ECF data 
includes metadata and text. IDW-S is synchronized against the ECF system once a day, a process 
which consists of receiving and processing the previous day’s increment of ADD, MOD, and 
DELETE records.! 1 


3.5.2 IntelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 


Outside the Scope 



3.5.3 SAMNet 

The Secure Automated Mess aging Network (SAMNet) data source consists of cable traffic 
messages received by the FBI.l 


SAMNet provides only ADD record types, and SAMNet data is updated in IDW-S three 
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3.5.4 VGTOF 


Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI National Crime 
Information Center (NCIC). VGTOF data includes two components: Data/met adata for each 
named individual/offender and potentially multiple JPEG images per individuaj 


3.5.5 JICI 


The Joint Intelligence Committee Investigation (JICI) data collection was created following the 
September 1 1 attacks. Paper counter-terrorism files/folders from all FBI Field Office^ ^ 


I JICI is a static collection that is not updated] ^ 


3.5.6 Open Source News 

The IDW-S VI. 0 system contains an Open Source News library collected by the DARPA TIDES 
Program. These are primarily news source from around the world that are either in English or 
have been translated into English. Open Source News data is received in the form of text files 
(one per news article) an d I The Open Source News data goes into IDW-S 

once a day. Open Source News dat ^***^^^^ I 

jOpen Source News material is derived from the following sources: 

Addis Ababa Tribune - http://www.addistribune.com/ 

Agencia Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 

AllAfrica.com - http://allafricrLCom/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://www.atimes.com/ 

Bangkok Post - http://www.bangkokpost.net/ 

Christian Science Monitor - http://www.csmonitor.com/ 


-23- 


b2 

h7F. 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 





UNCLASSIFIED // FOR OFFICIAL USE ONLY 


Investigative Data Warehouse (BDW) - Secret 
System Security Plan 
19 December 2003 

^ Version 0^ 

Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka 0srael) - http://www.debka.com 

East Africa Daily Nation - vmw.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://wvm.haaretzdaily.com/ 

IFRC International Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://wvm.irinnews.org/ 

Iraq Press News Agency - http://wvm.iraqpress.org/ 

Islamic Republic News Agency (Iran) - http://wvm.ima.com/en 
Jakarta Post - http://vmw.thejakartapostcom/ 

Janes - http://wvm.janes.com/ 

Jordan Times - http://wvm.jordantimes.com/ 

L'Osservatore Romano - wvm. Vatican. va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://wvm.guardiannewsngr.coni/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http-7/vwm.dailystar.com.Ib/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://wvm.mb.com.ph/ 

Manila Times - http://wvm.manilatimes.net/ 

Miami Herald - http://vmw.miami.com/ 

Moscow Times - http://wvm.themoscowtimes.com/ 

National Post and CP - http://vmw.canada.com/ 

New Straits Times (Kuala Lumpur) - http://wvm.emedia.com.my/Current_News/NST/ 

PETRA (Jordanian News Agency) - http://wvm.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.ne7 
Palestine Chronicle - http://paIestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://vmw.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://wvm.therussianissues.com/ 

Russian Observer - http://wvm.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://wvm.sabanews.gov.ye 
Saudi Gazette - http://wvm.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://wvm.dispatch.co.za/ 

Sydney Morning Herald - http7/vmw.smh.com.au 
Tehran Times - http://vwm.tehrantimes.com/ 

Times of India - http7/timesofindia.indiatimes.com/cms.dll 

UNHCR UN High Commissioner on Refugees - http://wvm.unhcr.ch/ 
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Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://vnvw.uzreport.com/eng/ 
Washington Post - http://www.washingtonpost.com/ 
XinHuaNews Service - http://www.xinhuaneLcom/english/ 
Yemen Times (weekly) - http://www.yementimes.com/ 
Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ [ 

3.5.7 Summary of {Data Sources| 
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3.9.9 Indirect Connections 
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1 Introduction 

The Federal Bureau of Investigation (FBI) Integrated Data Warehouse (IDW) is a data 
warehouse, content management, and data mining system that will permit FBI investigative, 
analytical, administrative, and intelligence persoimei to access aggregated data previously 
available only through individual applications. The IDW-S system will be authorized to process 
classified national security data up to, and including, the Secret level. 



ata processed by the system will include the tollowmg data sets: outside the Scope 

• Approved case files fi:om the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) 
defined archived documents; 

• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus File Rooms; 

• Violent Gang and Terrorist Organization File (V GTOF) from the Criminal 
Justice Information Systems (CJIS) Division; and 

• Open Source Data 


Note: Hardcopy veisions of this document must be verified for correct version number with the IDW O&M Document Control Library. 
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1. 4.1.1 Data Sources outside the scope 

The FBI maintains large databases of records. These records are recorded in both standard and 
vendor/developer unique formats. | ~~ 

I — 

Data processed by the system includes the following sources: 

• Approved case files from the FBI’s Automated Case Support (ACS) management system; 

• Electronic versions of the Joint Intelligence Committee Investigation (JICI) defined 
archived documents; 

• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPlus (INTEL+) File Rooms; 


Note; Hardcopy versions of this document must he verified for correct version number with the IDW CM Document Control Library. 
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Violent Gang and Terrorist Organization File (VGTOF) from the Criminal Justice 
Information Systems (CJIS) Division; 

Defense Advanced Research Projects Agency (DARPA) Translingual Information 
Detection, Extraction and Sximmarization (TIDES) Open Source Data. 



Note: Hardcopy versions of this document must be verified for correct version number with the IDW CM Document Control Library. 
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The data flow begins at the external data sources. These sour ces include various FBI 
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The data flow begins at the external data sources. These sour ces include various FBI 
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2.3.2 Special Projects Team (SPT) Subsystem 

The Special Projects Team (SPT) Subsystem allows for the rapid import of new specialized 
data sources. These data sources are not made available to the general IDW users but instead are 
provided to a small group of users who have a demonstrated “need-to-know”. The SPT System 
is similar in function to the IDW-S system. With the main difference is a different set of data 
sources. The SPT System allows it’s users to access not only the standard IDW Data Store but 
the specialized SPT Data Store. 

The table below lists the data and sources for the SPT Subsystem. 
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Chapter 
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Data Sourced 

Automated Case Support (CT Case Files) Archived Investigative dating back through calendar year 
1995. Updates pushed (FTP) to EDW once per day. 


2. Intel Plus: Updates pushed (FTP) to IDW as needed (usually once per day). 


i>2 

b7E 


3. JICI: Archived data ficom the Joint Intelligence Committee Investigation (JICI) regarding 9/11 as d i rected by 
the Congress of the United States. (Static file system) 

ORCON: Parsed data firom SAMNet and ACS data collections with this caveat. Pushed to IDW once 


per day. 


SAMNtttS SECRET and below cable traffic to/ firom FBI Headquarters. Pulled (FTP) from SAMNet 
server (IDW chronological job runs every 10 minutes; SAMNet posts new data 3 times per day). 

6. TFRG: Terrorist Financial records. Updates pushed (FTP) to IDW once per day. 

7. VGTOF: Violent Gang & Terrorist Offense File. Updated data file is provided in entirety by CD on a 
weekly basis. 

3» OSINlft Open Source Research (OSINT): Current from the MiTAP server. 
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INVESTIGATIVE DATA WAREHOUSE 


- SECRET 


SYSTEM SECURITY PLAN 
INTRODUCTION 

The Federal Bureau of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an 
initial data warehouse, content management and data mining system that will permit FBI 
investigative, analytical, administrative and intelligence personnel to access aggregated 
data previously only available through individual applications. The IDW-S system will be 
authorized to process classified national security data up to, and including. Secret. The 
IDW-S system is the successor of the Secure Counter-Terrorism/Collaboration Operational 
Prototype Environment (SCOPE”). 



Data processed by the system will include the following data sets; 


Outside the Scope 


• Approved case files from the FBI’s Automated Case Support (ACS) case 
management system; 

• Electronic vemions of the Joint Intelligence Committee Investigation 
(JICI) defined archived documents; 
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• Secure Automated Messaging Network (SAMNet) message trafSc; 

• IntelPlus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the 
Criminal Justice Information Systems (CJIS) Division; 


• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open 
Somce Data 
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Data Sources 


Outside the Scope 


IDW-S contains data from the following data soiurces with security classification indicated 
in brackets: 

• Automated Case Support (ACS) System, Electronic Case File (ECF) 
Subsystem [Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and 
below] 

• NCIC Violent Gang and Terrorist Offender File (V GTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DARPA/TIDES Open Source News [Unclassified] 



GTOF, Open Source News 




Received data l I nto individual serial records (in the case of ACS 

ECF), documents (IntelPlus, JICI, Open Source News), messages 
(SAMNet), or files (VGTOF). 
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3.5. Data Processed 
IDW-S processes the following data: 
3.5.1 ACS ECF 


Outside the Scope 


IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the 
Automated Case System (ACS). This subset consists of serials in those case 
classifications/subclassifications that have been officially sanctioned for inclusion 
in IDW. For each such serial, the ECF data includes metadata and text. IDW-S is 
synchronized against the ECF system once a day, a process which consists of 

receiving and pr ocessing the previous day’s increment of ADO MOD anH 

DELETE records! 


3.5.2 IntelPlus 

IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 
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3.5.3 SAMNet 

The Secure Automated Messaging Network fSAMNeO data source consists of ca ble 
traffic messages received by the FBlj 

\ SAMNet provides only ADD recor d 

types, and SAMNet data is updated in IDW-S three times a day. SAMNet dat j I 


3.5.4 VGTOF “ 

Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI 
National Crime Information Center (NCIC). VGTOF data includes two 
components: Data/metadata for each named individual/offender and potentially 
multiple JPEG images per individualf ~ ' 
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3.5.5 JICI 


The Joint Intelligence Committee Investigation (JICI) data collection was created following 
the September 1 1 attacks. Paper cotmter-terrorism files/folders from all FBI Field Offices 


pCI is a static collection that 

is not updated! ~ 


3.5.6 Open Source News 


The IDW-S Vl.O system contains an Open Source News library collected by the 
DARPA TIDES Program. These are primarily news source from around the world 
that are either in English or have been translated into English. Open Source News 
d^ta is re ceived in the form of text files (one per news article) 


jThe Open Source News data goes into IDW-S once a day. Open Source 
News data i ^ I 

Open Source News material is derived from the following sources: 


Addis Ababa Tribime - http://www.addistribune.com/ 

Agencia Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 
AllAfiica.com - http://allafiica.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - ht^://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://Avww.atimes.com/ 

Bangkok Post - http://www.bangkokpost.net/ 

Christian Science Monitor - http://www.csmonitor.com/ 

Crescent International - http://www.muslimedia.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debkacom 

East Afiica Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 
Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaretzdaily.com/. 

IFRC Intemation Federation of the Red Cross - http://www.ifrc.org/ 

IRIN Integrated Regional Information Network - http://www.irinnews.org/ 
Iraq Press News Agency - http://www.iraqpress.org/ 
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Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapost.com/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L’Osservatore Romano - www.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - http://www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscowtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 
PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://www.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - http://www.smh.com.au 
Tehran Times - http://www.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 
UNHCR UN High Commissioner on Refugees - http://www.imhcr.ch/ 

Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 

Washingtion Post - http://vww.washingtonpost.com/ 

XinHuaNews Service - http://www.xinhuanet.com/english/ 

Yemen Times (weekly) - http://www.yementimes.com/ 

Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ 


3.5.7 Summary of Data Sources 





1 






-25- 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 







UNCLASSIFIED // FOR OFFICIAL USE ONLY 


Investigative Data Warehouse (IDW) - Secret 

System Security Plan 
17 October 2003 
Version 0.2 


|i "1 ' 1 

tXMSMIg 

ACS 

FBI Automated Case 
System (ACS) 

FTP 

IntelPlus 

FBI Intel Plus 

FTP 

SAMNet 

FBI Secure Automated 
Messaging Network 
(SAMNet) 

FTP 

VGTOF 

FBI National Crime 
Information Center (NCIC) 

CD-ROM 

nci 

FBI Records Management 
Division (RMD), 
Document Laboratory 
(DocLab), FBEHQ 

Multiple 

Open 

Source 

News 

Translingual Information 
Detection, Extraction and 
Summarization (TIDES) 
Program, Defense Advanced 
Research Projects Agency 
(DARPA) 

CD-ROM 


Outside the Scope 
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4 Custom Software Applications 
4.1 IDW-S Data Ingest Applications 

Figure 4.1.1 is the dataflow diagram for the IDW-S data ingest process. 
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JICI Processing: The JICI data consists of one file room where each case file and serial is 
represent ed by a directory. Each directory contains the text and image files associated with 
the serial/ \ 

I JICI data is provided in 

entirety. 



VGTOF Processing: VGTOF is a structured data source that is currently available in IDW 
VLC i I The VGTOF data is 

composed of an ASCII source file of structured data records an( j 

files. The records for each individual are cotn bined into a document. | | 

VGTOF data is provided in entirety, replacing 

the previous data. ^ j 
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4.1 Operations 

The IDW system is broken up into three subsystems, each with a different set of responsibilities 
DOCLAB System 

IDW-S contains data from the following data sources with security classification indicated in the 
table below: 


Note: I iardenpy versions of this document must be verified for correct version number with the IDW CM Document Control Library. 
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FBI Automated 
Case System 
(ACS) 

Secret and below 




FBI IntelPlus 

Secret and below 




FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 




FBI National 
Crime Information 
Center (NCIC) 

SBU 




FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DooLab), FBIHQ 

Secret and below 




MiTAP 

Unclassified 





Note: Hardcopy versions of this document must be verified for cofKCt version number with the IDW CM Document Control Library. 
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Privileged Users Guide (PUG) IDW Operational Services 

Version 1 .2 PUG NG-OM-006 1.12 


The SPT-specific data sources wi ll include: 

• Financial Center (FinCenl 

• N6t^iy 

• . Selectee ^ 


Unified Name Index (UNI) extracts 


Outside the Scope 


b2 

:b7E 


Note; Hardcopy versions of (his document must be verified for correct version number with the IDW CM Document Control Library. 

PUG MG-OM-0061.12 
FOR OFFICIAL USE ONLY 
Page 16 



UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse - Secret (IDW-S) 
System Security Plan 
24 January 2005 
Version 1.5 


Federal Bureau of Investigation 
Information Resources Division 
Data and Information Management Section 



Investigative Data Warehouse - Secret 

(IDW-S) 

System Security Plan 

Document Version 1.5 
24 January 2005 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 


ALL IHFORIIATIOH COKTAIIIED 

HEPXIH 13 UNCLASSIFIED 

DATE 05-20-2008 BY 67159/DIIH/HKG/VTA 



UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse - Secret (IDW-S) 
System Security Plan 
24 January 2005 
Version 1.5 


Outside the Scope 


1.2.2 Supported Projects 

IDW-S is an FBI enterprise program/system and provides data and data processing/analysis 
services to FBI agents and analysts as they perform counter-terrorism, counter-intelligence, and 
law enforcement missions. The initial focus for the IDW-S Core Subsystem has been to support 
data analysis/data mining for the following FBI groups/activities; 

Counter-Terrorism Division (CTD) 

Special Event Unit 

In addition, scanning/OCR performed in the DOCLAB-S subsystem supports the following FBI 
projects/programs: 





Joint Intelligence 
Committee 
Investigation (JICI) 

Secret 

Federal Bureau of Investigation 
J. Edgar Hoover FBI Building 
935 Pennsylvania Avenue, NW 
Washington, DC 20535 

IntelPlus 

Secret 

1 1 

intormation Kesources Division 
Federal Bureau of Investigation 
J. Edgar Hoover FBI Building 
935 Pennsylvania Avenue, NW 
Washington, DC 20535 
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Automated Transfer of Raw Data to IDW-S 


Raw data is automatically transferred to the IDW-S system from approved data sources in 
accordance with an Interconnection Agreement, Memorandum of Understanding, Memorandum 
of Agreement or Interface Control Document. IDW-S V 1 receives update data by the following 
means: 


ACS update data is transmitted to the IDW-S systenF 


IntelPlus update data is transmitted to the IDW-S svstemi 


SAMNet update data is transmitted to the IDW-S svsteni 


VGTOF data is transmitted to the IDW-S system \ 

Open Source News data is transmitted to the IDW-S systenV” 

rir'i i : * i_,l- j i 


The JICI library is static and is not updated on IDW-S VI . 
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Parse and Format (Concatenated) Data to Individual Files (HTML) 
- Initial processing of raw data filei 


jJata into individual serial records (in the case of ACS ECF), 


document s (IntelPlus, JICI. Open Source News), messages tSAMNety or files 
(VGTOF)^ 


b2 

bVE 
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3.5.1. 1 IDW-S Core Subsystem Data Processed 

Table 3.5.1 .1 below outlines the IDW-S datasets and information about transfer and ingest 
processing for each source. 


ACS 

Electronic 
Case Files 
(KCF) 


FBI Automated 
Case System 
(ACS) 


Secret and below 
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lilsiMiSe 


IntelPlus 

Filerooms 


SAMNet 


VGTOF 


JlCl 


Open 

Source 

News 


FBI IntelPlus 


FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 


Secret and below 


Secret and below 


/'BI National 


Crime Information 
Center (NCIC) 


FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 


MiTAP 


SBU 


Secret and below 


Unclassified 


Table 3.5.1.1 IDW-S Data SeU 
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3.9.9 Indirect Connections 


3.9.9.1 IDW-S Core Subsystem Indirect Connections 







FBI Automated 
Case System 
(ACS) 

Secret 

FBI 

FTP 


FBI Intel Pius 

Secret 

FBI 

FTP 


FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret 

FBI 

FTP 


J-'BI National 

Unclassified/SBU 

FBI 

CD-ROM 


Crime 
Information 
Center (NCIC) 





FBI Document 

Conversion 

Laboratory 

(DocLab), 

Records 

Management 

Division (RMD), 

FBIHQ 

Secret 

FBI 

CD/DVD 
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MiTAP-Open 
Source News 

Unclassified 

NA 

CD-ROM 



3.9.9.2 SPT Subsystem Indirect Connections 

None. 


3.9.9.3 DOCLAB-S Subsystem Indirect Connections 


— 


(Mm 


FBI Investigative 
Data Warehouse 
- Secret (IDW-S) 

Secret 

FBI 

CD-ROM & 
FTP 
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OTHER 0/S 


low. Version 1.0 is scheduled for release January 2004 
and will provide access to six primary data sources: 

IDW Version 1.0 

0 Electronic Case File <£CF)/Automated Case Support (ACS) 

/Virtual Case File • FBI investigative and intelligence 
information. 

o SAMNET - wire traffic to the FBI from mer*>ers of the 
intelligence community. 

o JICI - counterterrorism files that were scanned into a 
database to accommodate the Joint Intelligence 
Committee Investigation (JICI) on the Septefrfcer 
11, 2001, terrorist attack on the World Trade 
Center. 

I h2 

hlE 


o VGTOF - Violent Crime and Terrorist offender File 

information that includes biographical data 
pertaining to meihbers of the identified groups. 

o Open Source - Fifty-seven neus sources from around the 
world that are either in English or have 
been translated into English. 





